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(57) Abstract 

An apparatus ftsr aad a method of non-iiacar constraint opdmisatton in a .storage system configumtioji. &t accodance wilfa iiie primaiy 
aspect of the present invention, the objective function for a storage systeta is determijied. The worJdoad units are selected and their standards 
are determined and the storage devices art selected and their characteristies are detemritied. These selections and deteiminations are then 
used by a constrsmt based sdver through non-Haesr cotisoaint integer optimization so generate an asisignment plan for the worJtlojid units 
to the storage devices. 
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APPARATUS FOR AND METHOD OF NON-ilNEAR CONSTltALNT OPTtMJZATION IN STORAGE SYS11EM 
CONFIGURATJON 

B^rKCRQirND OF TH£ I>rVTNnON 

FTFT D OF THE INVHNTION 

"ne prsseni invenuon rslaies generaliy to computer storage s>-sieins and psnaics 
more cardculariy to an appamriL^ for and a method of non-linear consiramt opdmizasioc 

is a storage srv^em conagurarioii. 

DISCUSSION OF THE PRIOR ART 

Storage systems for computsr networks can contain a large number of storage 
devices ha^-ing a wide variety of chaiacretisncs and a nearly arbitrary intercomiectiOD 
scbeins. The configuratioD and marmemenl of the storage wstem is central to the 
functioning of the computer network. In very large nsrworks, the inherent difficulties in 
configuring and managing the storage system are compounded by ^e sheer scaje of the 
network. The situation has reached the point where the time needed to configure a new- 
storage s>'stem can be several months and the cost of managing the storage system can be 
several times the purchase cost 

Large computer networks can contain a large number of host computers connected 
to the storage s>'stem. In such networks, many appitcation programs may be running 
concurrently on one or more of the host computers and each application program has a 

certain levei of service that it requires from the siorsge system in order lo run well. Tne 
storage allocation problem is to optimally lay out data accessed by the appiicadon 
programs on the optimal set of storage devices in the storage system, A solution to the 
problem is referred to as an assignment plan. 
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The opiimaiiiy of the resulting overall assigament plan is evaiuared based on an 
objective mncnon. For example, an objective flmcxion may be to minimize the cost of the 
storage system. An objective ftmciion may be to maximize the performance of the storage 

s\'Sttxn. Other objecBve functions include baiar.cmg tlie load. ma.xiinizin2 me availabiiin-. 
5 and minimizing the physical footprint. One of ordinary.- skill in die an will realize thai there 
are many other possible objective functions and thai, often, mulriple and competing 
objective fancnons will have to be balanced. 

A specific piece of data is referred lo as a workioad unit. .Associated e\"er>" 
10 workload unit are a set of standards. Standards include both the wori-doad tmii 
ciiaiaaerisacs and me application program access characteristics. For example, a standard 
may be the size of the workload unit- A standard may be the access speed or the access 
frequency of the application program. Other standards include request size, request rate, 
run cotmt. phasmg behavior, on time, oS'time. and maximum amount of data loss. One of 
1 5 ordinarv' skill in the art will realize that there are many other possible standards. 

Likewse, associated with every storage device are a set of characteristics. 
Characieiisdcs include both perfoimance measures and physical descriptions. For 
example, a characteristic may be the quantity of storage avaiiable on or the access speed 
20 of the storage device. A characteristic may be the size or the weight of the storage device. 

Other characteristics include position time, transfer rate, cost, outage frequency, outage 
l ength, and data loss rate. One of ordinary skill in the art will realize that there are many 
other possible characteristics, 

25 For the storage allocation problem, the questions of whether the various workload 

unit standards are compatible vdth the various storage device characteristics sen'e as 
constraints on the soiurion. Often, the constraints are iineai inequalities, thai is, 
expressions of the form 



30 



E a M'^ < f{d) 



Eq.(l) 
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where the values of a, and f(d) are consianrs for a given storage device, for example, 
auar.iit}' ofsiotage. outase Srsquencv; and data loss rate. However, some of the constrainis 
are non-lmex'-- for example, access speed and oiiMzation. Funher, some of the consn^nis 
are not inequaliiies. for example, existence of proper inierconnect cabling. Tnis mixture 
of constrainis serves to nurher compiicate the marter because if one could assume that all 
of the consG^xis w^re of one npe. then one could tailor the soiution to that t>pe of 
constraint, in pardcular. there are a number of good solutions if the constr^ts were all 
iinsar. Unfornmatsiy. that is sot necessarily the case here. 

So, the storage allocation problem can be %iewed on at least two levels. First- 
\%-hether a particular w-oikload unit can be assigned to a parncuiar storage de\ice. that is- 
whether the constraints are msL Second whether a particular workload unit should be 
assigned to a particular storage de\'ice given tiie resulting overall assignment plan, thai is, 
whether the objective function is optimized. 

There exist many standard optimization problems thai are similarly structured to 

the storage allocation problem. However, none of them are an exact match. As a result, 
none of them provide a model upon which to reach a solution. 

One standard optimization problem similar to the storage allocation problem is the 
classic bin packing problem. In the classic bin packing problem, the challenge is to fit a 

set of n items. I = (i,. - having fixed sizes. S = {s „ s ,....s into a set of m bins, B 
« {b„ b;,..-b„}, having fixed capacities. C = {c c ,,...c . Tne objective function Is to use 
the minimum number of bins possible given the constraint that the sum of the sizes of a set 
of items in a bin must be less then or equal to the capacity' of the bin. So, in the classic bin 
packing problem, there is only one objeciive function and one constraint. In the storage 
aiiocauon problem, howeven there may be multiple objective functions and multiple 
consiraints. As a result, solutions to the classic bin packing problem cannot be used 
directiy to solve the storage allocation problem. 
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Anorfaer standard optiraization prcblem similar lo the storage allocation problem 
IS the integer knapsack problem, in the ir.teger knapsack problem, die challenge is lo fit 
a s£i of n Items, having a nxt d size, S = { s s ;..-s J , and a defined value. 

V - {Vi, x;^..v„}, into a knapsack having a fixed size t The objective function is to 
5 maximize the value of a set of items placed into the kaapsack given the constraint that the 
sum of the sizes of the set of items in the knapsack must be less then or equal to the 
capacir>- of the knapsack. Again, m the ir,teaer knapsack problem, there is only one 
objective function and one constraint- Aittnsativeiy. there is s variant of the integer 
knapsack problem called the mulddimensionaJ kijapsack probiejD which takes into accotmc 

10 multiple capacitv' dimensions. An exampk solution is given in M4NAGE.VIENT 
SCENCE by Yoshiaki To^-oda (Toyoda) in an a-iicie entitled "A Simplified Aigoritfam for 
Obtaining Appro)dmate Solutions to Zero-One ProOTmming Problems." Even so, both of 
the knapsack problems differ &m the storage allocation problem in two significant waj-s. 
First the kn^sack problems asstime that the capa<m' dimensions can be captured as linear 

15 constraints. However, as noted above, this may not al^-ays be the case in the storage 
allocation problem and cannot be assumed. Second the knapsack problems assume a fixed 
number of knapsacks. However, in the storage ail ^cation problem, an objective fimction 
to choose the best set of storage devices may requite that storage devices be added or that 
storaae devices remain unnsed. As a result, solutions to the knapsack problems cannot be 

20 used directly to solve the storage allocation problem 

One computer specific optimizaiion problen similar to the storage allocation 
problem is die standard file allocation problem. In the s'^dard file allocation problem, the 

challenge is to place a set of « files, F - {f;. f,..X}, h< ving a fixed size, S = {s 
25 and a set of m tasks, T - {i i, t ,,...t J , onto a set of k rodes, H = (n, , n; ,,..11^ } , having a 
fixed capacirj", C « {c c ,,...c where each task needs 'o access at least one file and each 
file is accessed by at least one task. The objective fimction is to nunimize the file 
transmission costs of running the tasks given the consirant that the sum of the sizes of a 
sex of files cn a node must be iesi or ejual :c :r.e ca]>aciiy of the node. Again, in the 
30 standard file allocation problem, there is only one objectix e function. Aitematively, there 
are a number of variants of the standard file allocation pioblem. Even so, ail of the file 
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aijocation problems differ from the storage aliocation problem in that they assume a fixed 
number of nodes. However, in the storage aliocation problem, an cbjeciive ftmciion to 
choose the besx set of storage devices may reqiiire mat storage devices be added or mzi 
sioiage de\ices renjain unused As a result^ solutions to me file aUocation problems caimot 
be used directly to solve the storage allocation problem. 

in addition lo the above optimization problems, a number of narrow solutions hax's 
been proposed lo address indi\'idiiai aspects of the problem. .\n example of a narrow 
soitnion is presented in US. patent 5345.584 issued to Hill emiiled "System for Managing 
Data Storage Based on Vecior-Summed Size-Frequency Vectors for Data Sets. De\ic£S. 
and Residual Storage on Devices." Inis patem discloses a method xkm only considers the 
capaciiv' and access speed of the srorage device. Generally, ai! of the narrow solutions fail 
to pro%'ide a method for using arbitrary constraints or arbitrary objective nmctions. 

Given the preceding state of the art, it is not surprising lo Snd that configuration 
and management of the storage system has historically bees accomplished tiaough ad hoc 
solutions to the storage allocation problem. A foimalization of the storage allocation 
problem and a collection of a range of solutions would be a siaiificant advancement. 

SUMMARY OF THE rN\'ENTION 

li is a priman' purpose of the present invention to provide an improved apparams 
for and me^od of non-linear constraint optimization in a storage system configuraiion. 

In accordance with the primary aspect of the present inventioiL, the objective 
function for a storage system is determined, the workload units are selected and their 
standards are determined, and the storage devices are selected and their characieristics are 
determined. Tnese selecoons and determinations are then used by a constraint based solver 
through non-iinex" constraint integer optimization to generate an assigimient plan for the 
workioad units to the storage devices. 
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BRIEF DESCRIPTION OF THE DRAWING 

The above and other objecis and advantages of ihe present inx^ention be 
appreciated from the followng deiaiied description when read in cocjuncrlon wih the 
5 accompan>Tng drawing, wherein: 

FIG. i is a block diagram of a computer siorage constraint optiEsizaiion s}'sier;. 

FIG. 2 is a flow diagrasi of a compuier storage coriSinunt optimizaiion method. 

10 

PET AILED DESCRIPTION OF THE PREFERRED EMBOPDIENTS 

Toe pmpose of the present invention is to provide a formalizaiioii of the storage 
allocation problem and a collection of a range of soludons. The storage allocarion problem 
15 is referred to as being N?-hard which means that there is currently no known way of 
finding a provably optimal solution without checking every possible soitition. Generaily 
this is not piaciicai or necessary. The present invention discloses an apparatus and a 
method that reach a good, generally acceptable, approximate solution in a relatively short 
amount of time. 

20 

Tne present invention formalizes the storage allocation problem as a non-linear 
constraint integer programming problem. In this way one can apply results from a wide 
body of research on integer programming and optimization. This body of research gives 
one insisht into such problems as well as a large body of heuristics that can give good, 
25 though not provably optimal, solutions to the problem. 

In the generalized storage allocation problem, one is given a set of « vvorkioad 
iin't<i W - {Wj vv. . wj . a set of m storage devices, D = !d, . d. .,..d„ }, and a set of A- 
•.OT'rz V C = fC r C \ezz v^' j s Je^e-rnne a sc uor .-^ 

30 umi^ can be assigned lo a given siorage device based on me standaras uf aie \'.Oiivioau uxms 
and the charactsnstics of the storage aevsce. Ln its mosi general form, a consrramt C,, 
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sunpiy a foucdon derived from a set of workload units and a storare device that deteixnines 
a result from the set {irue. false} . It may be said that a consirahxt C, is satisfied for a ssi 
of workload units W and a storage device d if the nmction C p^^) is trae. Ir may be said 
thai an assignment of a subset of ^wrkload tmiis lo a storage vies d is feasible if. for 
5 si! constraints C, m the set of constraints C. the fimmon CXW^,d) is trae. RecaH also that 
die opmn2lit>- of the resulting overall assigtsment plan is evaluated based on an objective 
functioJL such as Or^''.w,d). that represents the vAmz of assigning a workload unit to 3 
storage dence given that a subset of the workJoad units is already a. :signed to the storage 
device. At Jeast imtially, ihe subset of workload units may be a null set. Typicaliy. a 
10 bisser obiective fonciion value implies a belter assignment. Given \his forsialisation. » 
is now possible to design a sj^stero to solve the storage ailocaiion problem. 

Ttiming first to FIG. L a block diasrani of a computer storage constraint 
optimizarion ^stem 10, according to the present invention, is shown. S /stem 10 includes 
15 a constnaint based solver 12. Solver 12 takes as an input both workload unit standards 14 
from a plurality of workload units (not shown) and storage device charatterisrics 16 from 

a piuralitv- of storage de%ices (not shown) (the standards 14 and the cban cteristics 16 are 
referred to collectively as constraints) and generates as an output an assiitxunent plan 1 8. 
Solver 12 accomplishes this through the operarion of a soiver algorthm 20 and a 

20 penormance model 22 both of which are governed by at least one objecti' 'e fimction 24. 
Solver algorithm 20 serves the functions of deteimining where to stan, where to proceed 
with, and where to stop the assignment process. Performance mode! .12 ser\-'es the 
functions of detennining if an assignment can be made and whai resources £ re left if such 
an assignment is made. Objective function 24 guides the assignment process md evaluates 

25 the result Recall from above that there may be multiple and competing objective nmciions 
24. One of ordinary skill in the art will realize that system i 0 shown may be implemented 
using software, hardware, or a dedicated signal processor (DSP). 

Turning now to FIG. 2. a fiow diagram of a compuier storage constraint 
30 optimization method is shown. The method assigns a piuralit>' of workload units to a 
plurality of storage devices and begins with step 30, At step 30, at least one objective 
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nmction is detennined. Next, at step 32 one or more ofxhc piuralirv' of workload uniis is 
seiecied Tnen. at step 34 the standards of the selected workload units are determined. At 
siep 36. one or laore of the piiiraiirv* of storage devices is selected. Then, ai step 38 the 
chHTSCierisiics of the selecied storage devices are determined. An assignment piaxi js 
generated for the workload uruts to the storage de^-ices- in step 40. Next, at step 42 the 
assignmeRi plan is e\^tiated either against some criteria such as the objective fvinction or 
against some akeroaiive plan. Finaliy, ai step 44 the assignment plan is impiemented if 
^.o-ro-v-ed. One of ordman- skill in the an will rsatize that additional steps may be added 
to the njsmod or thai one or more of the steps may be repeated as necessary to generate an 
approved assignment plan, 

A range of soltnions is possible depending on what opdmization heuristic is used 
to generate the assignment plan at step 40. A collection of heuristics wiU be presented 

beiow. Tney are generally organized into two groups. First, a set of well know heiiristics 
are adapted to the storage aiiocanon problem as forma!i7.ed above. These are referred to 
here as the first-fit betirisiic and its variants. One of ordinary skill in the art wiii readily 
ideniir.' other well known hetJiistics, such as simulated aaneaiing, genetic algorithms, and 
linear relaxation, that could be adapted without departing from the spirit of the inveiiiion. 
in the interest of brevir\\ the fust-fit heurisiics are presented as examples of the plethoia 
of well known heuristics that could be used. Second, a set of new heuristics, referred to 
here as the gradient based heuristic and its variants, ■will be disclosed. No one optimization 
heuristic is preferred above all the others. The choice depends on what constraints and 
objective functions are being considered. 

The first coHection of heuristics is based on the first- fit hetmstic. The essence of 
the "simple" heuristic is to systematically assign each workload unit to the first storage 
de\ice for wiiich all of the constraints are satisfied, that is, tlie first device that It "fits" on. 
For example, assume that in a storage aliocaiion problem, one is given a set of n workload 
units, W= {w,, vv...,.u;}, and a set at m storage dex'ices. D » id d ^....d J. .According 
10 die simple heuristic, one begins v^ith workload unit w, and checks it first against storage 
device d, to see if it fits. If so, then w , is assigned to d , . If not, then one checks to see if 
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\v, fits wtb d ; , If W; is such that it does not fit wth any of the storage devices, then k is 
simvh noi assigned. This process is repeated until all of the workioad uaiis have been 
addressed or aO of the storage devices are Lsipiicit in this heimsiic is that it acts lo 
nixiirnize the number of storage devices used in the assignmetit plsn. One aspect of this 
heuristic is that it operates only on the most genera] form of constraints and not on 
constimabie constraints ss will be disclosed belo-w". 

Since the simple ^zsi-m heuristic dsscf.vid above is con:pie:eiy aeper-ceni on isis 
order of the -workioad units and the storage de\-ic5S. i: is yasi 25 iikeiy lo DTid ±e worst 
'ssisnment pian as it is the best. A Srst variant to Lhe simpie heuristic is to perform the 
heuristic muinpie times uith the order of the workload units or the storage devices changed 
and cainparing the results of the dinereni runs. Randomly shuMing the order of both the 
workload units and the storage devices betv.'een each run increases the odds tiiat a good 
assignment plan v^iii be found. Likewise, the more runs one penoims, the better the odds 
ars. However, in the interest of reaching a good assignment plan in a timely manner, either 
the number of runs or the amoimt of time for runs may be iimjted. 

A second variant to the simple first-fit heuristic is to son both the workload units 
and the storage devices before peribrraing the heuristic. Carefu-IIy soning the order of boili 
the workload units and the storage devices increases the odds that a good assignment pian 
will be found. For example, sorting the workioad units from largest size 10 smallest size 

tends to increase the chances that later workload units will fit into the space left over in the 
storage devices by the eariier assignments. 

A third variant to the simple first-fit heuristic is lo perform the hetmstic using a 
more round robin approach to which of the storage devices is checked first. Instead of 
zlwzvK lix-^i checking the nr^i storage device dj vvrJi each new workioad umt, the storage 
..e .vj t.ianoJov\ .^.siorajvUexiceLhatrecsixedtnepreMOU ds^gnments checked iV' 
Lie next time Fo- e\^.:;.e a-^^u-^^e indi ne usual manne- 1 ^^nrUoad urit w . 
assigned t a storage device C, Tlien for the ne\t \\orkioad unr \^ , one nrs: cne^.^s tr. 
next storage devjce d„j and works back to d by wiapprng arounu tutti me last storage 



wo 00/3 J 640 PCT/US99/2T3S5 



device 4 to me nist d .. Again, this process is repealed until all of the workload mn\ s have 
been addressed or all of the storage devices are Ml Lmplicit in this variant is that it acts 
■ 0 e\ en.iv distnbme the workload units over the storage devices tissd in the assigiment 
znzn. This third variant could also be used in combination with either of the previous two 
5 %-2riants. 

The second collection of heuristics originates Srom a giadisnt based hearistic. Tnt 
i-rsi-nt heirnsiics produce assignment plans that satis^- the basic constraints, but the>- do 
not X2kz inio account me inisrpla>- ber^-een the dinersni dimsasicns represented by ;he 

0 consirainis. In order to balance the interplay, the gradient based hetiristics combine ^he 
ineau2lit>- constraints in different dinjeiisions to formulate the assignmem plan. A major 
development is to realize thai say inequality constraint of the form fC^4) < C^, where 
is a constant that may depend on d and the fhnction f is a monoionicaliy non-decreasing 
function, can be thought of as consumable. Such a constraint can be said to be consumabl i 

5 because one can determine how much the addition of a workload unit to a storage de-vice . 
with some workload units already assigned to it will consume of that resource. The 
calcuiarion of how much lesource is consumed by the addition of workload unit w is trivial 
for a linear constraint where the amount consumed is equaJ to ajW, That is, the amount 
consumed can be determined by looking at workload unit w in isolation. For a non-linear 

0 consumable constraint however, the amount of resources consumed by the addition of 
workload unit w depend on what subset of workload units W are already assigned to 
the storage device. It is pivotal to realize that the difference in resotaree usage beiuesn ihe 
stoi^ae dev ice wth and without the addition of workload unit w can be calculated and this 
difference can be used to treat non-iinear constmiable constraints as linear ones in any 

5 gradient funaion created for linear constraints. For example, the Toyoda gmdieni function 
will be adapted below. 

According to the simple heuristic, one begins by calculating a set of first gradient 
funcdons for all of the workload units and all of the storage devices. Then, one determines 
0 which first gmmmt function has the greatest value and assigns the corresponding workload 
unit to the corresponding storage device. Next, one calculates a set of new gradient 
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functions for the remaining workload units and ali of the storage devices. Then, one 
ceierminss which new gradient mnction has the greaiesi value and assigns the 
corresponding workload unit to the corresponding storage device. Tais process is repeated 
untii ail of the workload units have been addressed or all of ifae storage devices are full 

in generai. the key to the gradient based heuristic is a non-negative gradient 
faction G(W.w.d), tirnt represents the \-aiue of assigning a workload unit w to a storage 
d-vice d gi\-en that a subset of the workload units W is already assigned to the storage 
d^vici. At least irJiialiy. ihe subset of workload uni^-S may be a null set. Tne gradient 
lO ronction is equal to zero if the assignmeat is infeasibie. Topically, a bigger gradient 
iunction value implies a better assigameni. A number of gradient functions are availabie. 

A first gradient function accoiding to the present invention is referred to as the 

cosine-gradiem i\incdon. The tbeorv' is to represent the storage device as a point in vector 

1 5 space with dimensions that correspond to the remaining capacity of each of its consumable 
constraints. With respect to a partictilar storage device and the corresponding set of 
woiidoad units assigned to it, a new workload unit can also be represented as a point in this 
vector space by plotting the amount of each consumable constraint that the woridoad unit 
would consume if it were to be assigned to the storage device. Ideally,, one would like to 

20 find a set of workload units that folly utilizes all of the consumable constraints. One way 
that one can accomplish this is to assign workload units witli opposite needs. For example, 
one can assign one workload unit with high capacity needs and low performance needs 
with a second workload unit wth low capacit>' needs and high perfoimance needs. 
Gsometrically, this is equivalent to favoring assignments that minimize the angle of 

25 incidence between the storage device vector and the sum of the workload tmit vectors for 
workload units on that storage device. Thus, if one takes the gradient flmction to be the 
cosine of the angle of incidence between the vector representing bow much of each 
consumable constraint the workload unit would use if it were placed on the storage device, 
and the vector representing how much of each consumable constraint the storage device 

30 has available, then one obtains a gradient between zero and one such thai larger gradient 



wo 00/31640 



-12- 



PCT/US99/27383 



\-aiues. corresponding to smalier angies, imply beuer fits. So. rhe cosine-gradiem fttnction 
C2n be written as 

G(W,w,d) « (F-SydFjiSj) Hq.(2! 

where W is the workioad unit reqiiirement vector and D is xhe storage ds\1ce available 
vector. Experiments vdih the cosine-gradient rancrion have generally provided acceptable 
rssuits with the one sxcepiion beir.g that consumable constraints wiih 'v^idei}' disparate 
ranges can skew the rsSTiits to favoring one dimension or another. 

10 

A second gradient nmction according to the present invention is refstred to as the 
nonnaiized-cosine-gradieni mnction. To address the skewing problem ^^ith the cosine- 
aradienr function above, one can nonnaii^e ihe workload tasit and storage device vectors 
so that the storage device vector is the unit vector. .Aiter normairzadon. one again takes 
1 5 the cosine of these two vectors to fae the gradient fiinction. So, the normalized-cosine- 
aradient ftmction can be written as 

G(W,w,d) = ((F/5).(^/5))/({F/5i!iD/5}) Eq.(3) 

20 where "W/D « < Wj/d„ w,/d,,...w/d„ >. 

.A. third gradient fiinction is an adaptation of the gradient fhnction presented by 
Toyoda but extended to multiple "knapsacks" or storage devices md to consumable 
constraints. Tne Toyoda gradient function is based on r^vo vectors B ~ < b,. b;,,.,bi. > and 

25 F = < f , . f ;,...f i >, where k is the nmnber of consumable constraints for a given probiem . 
Each element b, of the vector B is the amount of a consumable resource / used by the subset 
of workload units W previously assigned to a particular storage de\-ice d divided by the 
total amount of that resource that that storage device staned vvith. Each element f, of the 
vector F is the amount of a consumable resoirrce / used by assigning a workload unit w to 

30 a panicuiar storage device d divided by the total amount of that s^source that that siorage 
device started with. So, the Toyoda gradient function can be written as 
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G(W,w,d) - {VB'3y(B*F) . Hq. (4) 

I: imponsni lo note mat Eq. (4) is undefined when no workload imiis ars assigned, since 
3 » < 0. 0.-.O > in the case where no workload urjis are assigned. In ihis case lex 



in addition to the range of solutions made possible by vaning the opmnizatjon 
hsurlsdc. 2n improved range of soludons is possible through the application of one or more 
obi active functions. Any parJcuiar goal can be achieved by the comptner storage 
conj-nsint optinit2anon method through the appiicahon of an objecti\'e itmction, OCWav.c). 
For example, to generate an assignment plan that achie'ves a balanced loading of all of the 
stDiEge devices, the objecm'e Unction might be the expected faction of unused band\^idih 
if wc ikload units W and w ^^-ere assigned to storage de-vice d. With ihis objective ftmciion, 
the composite gradient ftmciion can be writren as 



wher; G(W,w,d) is either the cosine-gradient function or the normaiized-cosine-giadient 

functi on outlined abo%'e. Thus, subject to balancing the fit of the various constraints of a 
20 storage device, mmimizing the maximum percent of bandwidth used would be preferred, 
in practice, any objecrive fimction can be composited v^ith the gradient fimctions to weight 
them for a particular goal as desired, 

.^n extension of the To>^da gradient fimction is to composite it with the obj ecii\'e 

2 3 ftinction of supporting the greatest number of worldoad units on the cheapest set of storage 

device;?. Tnen, the composite gradient function can be v»Tiiien as 

G'(W.^,d} ^ maxcost + (benefitC^M'^^M ~ cosT(d) Eq. (6) 

3 0 where n laxcost is the maximum cost of any storage device in the set of storage devices. Li 

most ca-ses. all of the worldoad units have an equal Vrxight, so for ail w. benefii(w) is equal 
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to one. Tnis gradient iimction has produced quite good assigmnent plans of workloads 
onto a iow cost set of devices- 
IB pracdce, h u-as noted that the above eriension of the Toyoda gradient foucxion 
5 was favoring packing smail size workload units onto sioracs desicss before large size 
woiidoad units, if one has a high disparitv' in workload unit sizes ana one inisncs to assigr. 
all of the workload units, it is oiien better to assign the lai^e size workload units firr^ To 
accomplish mis. one need oni\' inven uhe gradient nisction in £q. (6), Tnea. the resuiiing 
con-iposite gradient function can be wriuen as 

iO 

G''(W\w,d) = maxcosi - (benent(wyGiW\w,d}) - cost(d) . Eq-(7) 

Tnis gradient nmaion has also given good assignment plans, especially in the case where 
the workload units have qtiite disparate sizes. 

15 

Through the variation of the optimization heuristic and Lhe application of one or 
more objective functions, a Jull range of solutions is made possible. Given the speed of 
\%iiich assignment plans maybe generated through the present invention, new oppormnities 
present themselves. For example, rather than configuring a storage system only once, one 

20 can reconfigure it essentially at will. A new configuration can be generated every thne a 
workload unit or a storage de\'ice is added or deleted. A new configuration can be 
generated to account for an imponant project like a new product release or a signincant 
event like the end of the fiscal year. Through the use of empirical data feedback, a new 
configuration can be generated to better realize the original goals. Each of These new 

25 oppominities represents an improvement over the state of the art. 

Whih the invention has been illustrated and described by means of specific 
embodiments^ it is lo be understood that ntimerous changes and modifications may be made 
therein without departing fiom the spirit and scope of the invention as defined in the 
50 appended claims. 
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CLAIMS 

\\"hat is claimed is; 

1. An apparatus for non-linear constraint optiiiiization in a sxorage s>'stem 
having a piuralirv' of workload units and a piuralin* of storage devices, the apparauxs 
comprising: 

E consrraint based solver wharsby workload unit s:candards end storage dsxks 
charactsrisrics are rec£j\'£d as iiEpuK and an assignment plan is generated as an ouipui: 

wherein the consaraini based solver comprises a solver aisorithm and a perfonnancs 
dodel and wiherein the solver aigorithm comprises a gradient based beurisdc, 

2. Hie appararus according k> ciaim 1 , inlierein the solver algorithm comprises 
a cosine-gradient function- 

3 . Txie apparatus according u> claim 1 , wherein the solver algorithm comprises 
a nonnaiized-cosine-gradient function. 

4 . The apparatus according to claim 1 , wherein die solver algorithm comprises 

a Toyoda adaptation gradient fiinction, 

5. The apparatus according to claim 1, wherein the constraint based solver 
mnher comprises at least one objective function which governs the solver algorithm and 
me perforaiance model wherein the solver algorithm comprises a composite gradient based 
heuristic instead of the gradient based heuristic. 

6. Hie appamtus according to claim 1 , wherein the solver aigoriihm comprises 
at least one difference in resource usage between the storage device widi and wihout the 
addidon of the workload unit whereby the diSerence is used to treat non-linear consumable 
consiraints as linear ones. 
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7 . A method of non-Imear constraint optimization in a storage system ha\ing 
2 plurality of woridoad units and a pitiraliiy of storage devices, the method comprising the 
sisps of: 

st-lectlng the workload units: 

dcienmmng staadm-ds of the workioad units; 

seleciing the storage dex-ices: 

di Lermining cbaracxerisiics of the storage devices: 

gs neraimg an assignment plan for workioad units to storage devices based on the 
standards and the characterisdcsi and 
ewiiuating the assignment plan; 

%i;ereia the step of generating an assignmeni plan comprises the step of assigning 
each w'Dikiaaa unit to the storase device for which a corresponding gradient fimction vaiue 
is the giraiasL 

8. The method according to claim 7, wherein the step of generaiing an 
assignment plan further comprises the step of caictilating a cosine-gradient function for 
each workload unit and each storage device. 

9. The method according to claim 7, wherein the step of generating an 
assignment plan ftirther comprises the step of calculating a normalized-cosine-gradieni 
function for each workioad unit and each storage device. 

10. The method according to claim 7, wherein the step of generating an 

assignment plan flinher comprises the step of calculating a Toyoda adaptation gradient 

fonction for each workload unit and each storage de\ice. 

1 1 . Tne method according to claim 7, further con^rising the step of deteimining 
one or more objective function prior to the step of selecting the workioad units wherein the 

step of generating an assignment plan comprises the step of assigning each workioad unit 
to the storage device for which a corresponding composite gradient fonciion value is the 
greatest is tised in place of the gradient fonction. 
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12. The method according to claim 7. linxher comprising the steps of; 
impismenting the assignment pian; 

obiaining empirical perfonrsance measuremems of the assignment plan; and 
rsevaluating dae assignment plan. 

B, The method according to ciaiia 7. wherein the step of generating an 
assignment plan further comprises the step of calculating at least one diiferencs in resource 

usage benveen the storage ds\-ice uiih and wirhoui the addition of the workioac unit 
■vvhareby the dinerence is used ro treat non-linear consumable constraints as linear ones. 

!4. A comptiter-readable memory that can be used to direct a computer to 
psrfoun a non-iinear constraint optimi2arion in a storage system having a pltiraiiiy of 
woiidoad units and a pliaaiit)' of storage de\'ices, the optimizaiion compiising the steps of; 

deteimiaing at !east one objective function: 

selecting the workload units; 

determining standards of the workload uniis; 

selecting the storage devices; 

determining characteristics of the storage de\ices: 

generating an assignment plan for worldoad tmits to storage devices based on the 
standards and the characteristics; and 
evaluating the assignment pian; 

wherein the step of generating an assignment pian comprises the step of assigning 
each workload unit to the storage device for which a corresponding composite gradient 
function vaiue is the greatest. 

15. The memory according to claim 14, wherein the step of generating an 
assignment plan funher comprises the step of calculating a composite cosine -gradient 
ninction for each workload tinit and each storage device. 
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16. The memow according lo claim 14. wiierdn ihe siep of generating m 
assigximeni plan further comprises ihe siQp of calculating a composite nonnalized-cosine- 
ajadient mnction for each workioad unit and each storage device. 

17. The memor>- according to ciaim 14. whereui the sizp of generating an 
assisument plan mrtfaer comprises me step of caicuiadng a composite Toyoda adaptation 
aradient nmcxion for each workioad unit and each storage de\ice- 

I S . Tne msmon- according to ciaini 1 4. fiinher comprising the steps of: 

implementing the assignment plan: 

obtaining empirical peribrraance measurements of the assigmneat plan: and 
reevaiuaring the assignment plan. 

19. Hie memory according to ciaim 14^ wherein the siep of generating an 
assignment plan fisrher comprises the step of calculating at least one difference in resource 

usase becvveen the storage device wiih and without the addiiion of the workload unit 
whereby the difference is used to treat non-linear consumable constraints as linear ones. 
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